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Abstract 

Background: Care pathways have become a popular tool to enhance the quality of care by improving patient 
outcomes, promoting patient safety, increasing patient satisfaction, and optimizing the use of resources. We 
performed a disease specific systematic review to determine how care pathways in the hospital treatment of heart 
failure affect in-hospital mortality, length of in-hospital stay, readmission rate and hospitalisation cost when 
compared with standard care. 

Methods: Medline, Cinahl, Embase and the Cochrane Central Register of Controlled Trials were searched from 1985 
to 2010. Each study was assessed independently by two reviewers. Methodological quality of the included studies 
was assed using the Jadad methodological approach for randomised controlled trials, controlled clinical trials and 
the New Castle Ottawa Scale for case-control studies, cohort studies and time interrupted series. 

Results: Seven studies met the study inclusion criteria and were included in the systematic review with a total 
sample of 3,690 patients. The combined overall results showed that care pathways have a significant positive effect 
on mortality and readmission rate. A shorter length of hospital stay was also observed compared with the standard 
care group. No significant difference was found in the hospitalisation costs. More positive results were observed in 
controlled trials compared to randomized controlled trials. 

Conclusion: By combining all possible results, it can be concluded that care pathways for treatment of heart 
failure decrease mortality rates and length of hospital stay, but no statistically significant difference was observed 
in the readmission rates and hospitalisation costs. However, one should be cautious with overall conclusions: what 
works for one organization may not work for another because of the subtle differences in processes and 
bottlenecks. 

Keywords: Care pathways, Heart failure, Hospitalisation costs, Length of hospital stay, Mortality rate, 
Readmission rate 



Background 

Chronic heart failure (CHF) is a growing health problem. 
About 5.7 million people suffer from CHF in the United 
States [1] and approximately 5% of all acute medical 
admissions are HF-related in Europe [2], HF is a leading 
cause of mortality. It has been stated that in 2006, 1 in 
8.6 death certificates in the United States mentioned 
heart failure [3]. It is probably the most costly chronic 
disease. Its high prevalence and mortality rate places a 
huge economic burden on the health-care system. The 
estimated direct and indirect costs of HF in the United 
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States in 2010 were $39.2 billion in total [3]. It was 
reported that the cost of HF care is two times higher 
than the cost of breast cancer, and three times higher 
than the costs of colorectal and lymphoma cancer care 
in the USA [4]. Thus, HF management is a big challenge 
for todays health-care systems, and care services for HF 
need to be adjusted to reduce costs and mortality rates 
without compromising the quality of patient care. Care 
pathways (CPs) have become a popular tool to enhance 
the quality of care by improving patient outcomes, pro- 
moting patient safety, increasing patient satisfaction, and 
optimizing the use of resources [5,6]. The European 
Pathway Association (international not-for-profit associ- 
ation) defines CPs as "a complex intervention for the 
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mutual decision making and organisation of care pro- 
cesses for a well-defined group of patients during a well- 
defined period" [7,8]. According to the European care 
pathway association, defining characteristics of CPs in- 
clude: (i) An explicit statement of the goals and key ele- 
ments of care based on evidence, best practice, and 
patients' expectations and their characteristics; (ii) The 
facilitation of communication among team members and 
with patients and families; (iii) The coordination of the 
care process by coordinating the roles and sequencing 
the activities of the multidisciplinary care team, patients 
and their relatives; (iv) The documentation, monitoring, 
and evaluation of variances and outcomes; and (v) The 
identification of the appropriate resources. The aim of a 
care pathway is to enhance the quality of care, across 
the continuum, by improving risk-adjusted patient out- 
comes, promoting patient safety, increasing patient satis- 
faction, and optimizing the use of resources [7]. 

Although CPs have been used since the 1980s, and 
many high-quality articles have been published in inter- 
national peer reviewed journals describing their benefits 
[9,10], the effectiveness of CPs is still controversial [11- 
13]. Systematic reviews and meta-analyses have received 
increasingly more attention from investigators for evalu- 
ating the effect of the implementation of CPs [14-16]. 

The results of some generic and disease-specific meta- 
analyses showed that pathways are effective in improving 
clinical and patient-related outcomes [14-19]. But none 
of them showed a significant effect of CPs on heart fail- 
ure or in hospital treatment. Therefore, in this study we 
performed a disease-specific systematic review to show 
recent evidence of how CPs for hospital-based treatment 
of heart failure (HF) affect in-hospital mortality, length 
of in-hospital stay (LOS), rate of readmission, and hospi- 
talisation costs. 

Methods 

Literature search 

A dual approach was used to search the literature. 
Firstly, MeSH key words of "critical pathways" AND 
"heart failure" AND "congestive heart failure" were 
searched in Medline, Cinahl, Embase and the Cochrane 
Central Register of Controlled Trials databases. Sec- 
ondly, a non-MeSH approach was used based on the fol- 
lowing search string: clinical pathway OR critical 
pathway OR care map' OR clinical path' OR multidis- 
ciplinary approach' AND "heart failure OR congestive 
heart failure". No limits were used except publication 
year. Because the first CPs in healthcare originated in 
the 1980s [20] the search was limited to years between 
1985 and 2011. The authors of five relevant studies were 
contacted for further information. One author provided 
the original data [5]. The other authors did not reply 
[21-24]. 



Study inclusion/exclusion criteria 

We included randomised controlled trials (RCTs), con- 
trolled clinical trials (CCTs), controlled before-after 
studies (CBAs), and interrupted time series (ITS) in the 
systematic review. Studies were considered randomised 
when it was specifically stated in the text. All of the 
included studies compared the care provided through 
CPs with standard medical care. Studies were included 
when at least one of the following outcome indicators 
had been evaluated: hospital mortality rate, rate of re- 
admission, length of hospital stay (the number of days of 
acute hospitalisation from admission to discharge) and 
hospitalisation costs (total cost of acute hospitalisation). 
Articles that were strictly descriptive (study protocols, 
review articles and theoretical articles), articles with no 
control group, articles that did not assess at least one of 
the four outcomes and articles for which the relevant in- 
formation could not be retrieved were excluded. "Only 
studies which met the care pathways definition of EPA 
were included [8]. For this purpose a specific checklist 
has been developed to analyze the papers (Additional file 
1: Annex 1). The papers that met at least 5 or 6 criteria 
have been included in the study (Additional file 1: 
Annex 2). All of the excluded articles and exclusion rea- 
sons were given in the Additional file 1. 

Outcome measures 

In this study, results were combined according to four 
outcome indicators: hospital mortality rate, rate of re- 
admission, length of hospital stay (the number of days of 
acute hospitalisation from admission to discharge) and 
hospitalisation costs (total cost of acute hospitalisation) 
to evaluate the overall effect of CPs on HF. These were 
the most commonly used and available outcomes in the 
included studies. 

Data extraction and quality assessment 

The author, the publication year, the sample size, the 
characteristics of the population studied (age, sex, race, 
primary diagnosis, etc.), study design, type of control 
and outcome measures were recorded. Two reviewers 
independently screened the titles, abstracts and key- 
words to determine eligibility and assess methodological 
quality of the included studies and record the findings. 
The reviewers were blinded to the names of the authors, 
the institution where the study had been carried out, 
and the journal. Any disagreement was discussed with a 
third reviewer. Methodological quality of the included 
studies was evaluated using the Jadad methodological 
approach for RCTs and CCTs and the New Castle Ot- 
tawa Scale for interrupted time series [25,26]. All the 
studies that met the inclusion criteria (see above) but 
did not include any items of the checklists were 
excluded. 
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For dichotomous variables, counts were calculated by 
using percentages given in the articles. If an article only 
reported confidence intervals instead of standard devia- 
tions, standard deviations were calculated via the confi- 
dence interval formula (mean ± 1,96SE). Also, some 
results not described in text or tables but shown in graphs 
were extracted from the graphs by using data extraction 
software with the mean and confidence intervals given in 
the graph (XY data extraction software version 4.1). 

Data analysis 

The primary meta-analyses were performed according to 
the guidelines set out by the Cochrane Collaboration 
regarding statistical methods [26]. For dichotomous vari- 
ables, risk ratios (RR) and 95% confidence intervals (95% 
CI) were calculated using standard care group as the 
reference group. For the meta-analysis of continuous 
variables, the Weighted Mean Difference (WMD) with 
95% CI was used. Since different kinds of study design 
were combined and the sample sizes of included studies 
were different, a random effects model' was used for all 
the outcomes [27]. In order to compare CPs with usual 
care, the costs were measured in United States dollars 
(US$) divided by 10,000 and expressed as the Weighted 
Mean Difference (WMD). One of the three included 
studies reported the costs in Euro (€)[10]. These costs 
were converted to US dollars ($) using the official ex- 
change rate of the year of study data (year 2004). The 
costs were adjusted for the inflation rate in the United 
States and actualised to year 2004. Sensitivity analysis 
was performed to identify studies with a low quality [27]. 
For each outcome, meta analyses were repeated many 
times to check the robustness of findings using different 
assumptions. The largest, the smallest, the earliest 
studies and the studies with the most different results 
were excluded respectively to see the effect on the 
results. These sensitivity analysis results are given in 
the Additional file 1. In addition to sensitivity analyses, po- 
tential publication bias was assessed using a funnel plot 
which is a scatter plot of the estimate of the effect from 
each study in the meta-analysis against a measure of its pre- 
cision, usually 1/SE [27]. The results for each outcome 
measure were presented separately for different study types. 

The results for each outcome measure were presented 
separately for different study types with forest plots. 
Analyses were performed using the Review manager 
software package (RevMan), version 5.0 and a P- value 
smaller than 0.05 was considered to be statistically 
significant. 

Results 

Description of the studies 

The search strategy resulted in a total of 7981 records 
(6553 irrelevant, 1382 duplicated). Among 46 studies 



identified, only 7 publications met the study inclusion 
criteria [5,10,22,23,28-30] and they were included in the 
systematic review for a total sample of 3,690 patients, 
as shown in Figure 1. This systematic review consists 
of three randomised controlled trials [11,22,23] one 
interrupted time series [5] and three controlled studies 
[28-30]. 

Summary of included study characteristics were given 
in Table 1. Two publications reported results of studies 
with a multi-centre design, whereas five were single- 
centre studies. Two studies were based in Italy, four in 
the USA, one in Canada. The setting characteristics of 
the studies (hospital size, urban/rural typology, educa- 
tion, living conditions) were not fully reported. 



Effect of CPs: mortality rate 

Five studies were included in the systematic review 
(three randomised controlled, two controlled studies) to 
estimate the pooled risk ratio for mortality of the care 
pathway group compared to standard care. A total of 
2,343 patients were analysed, including 1206 patients in 
the care pathway and 1137 patients in the standard care 
groups. The use of CPs had a significant positive effect 
in 2 of 5 studies, including the mortality rate [5,10]. 
Also, in the other three studies, the mortality rate 
decreased in the care pathway group, albeit not signifi- 
cantly [22,23,29]. Risk ratio (RR) estimates and their 95% 
confidence intervals are shown in Figure 2. The overall 
result of combining the RCTs was not statistically sig- 
nificant. The pooled risk ratio for mortality was 0.45, 
95%CI = 0.21-0.94, P = 0.03. 



Records identified through 
database searching 
(n = 7981) 



Records after duplicates removed 
(n=1382) 



Records screened 
(n = 6559) 






Articles assessed for 
eligibility 
fn = 46^ 







Irrelavant records 
excluded 
(n =6553) 



Studies included in 
qualitative synthesis 
(meta-analysis) 
(n = 7) 



Full-text articles excluded, with 
reasons 
(n =39) 
* Historical and theoretical 
articles (15) 
•Reviews (2) 
'Not specific articles (7) 
'Articles no relevant information 
could be retrieved. (13) 
'Not enough information (1) 
'Study design (1) 



Figure 1 Flowchart of the selection of the studies. 



Table 1 Summary of included study characteristics 



Author 


Study design 


Control 


Setting 


Length 


Patients 


Sex% Male 


Mean age 


Patients 


Main outcome 


NYHA 






type 




of study 
(months) 




Pathway 


Control 


Pathway 


Control 


demographics 




class 


Panella 

2009 


CRCT 
(multicentered) 


Prospective 


14 hospitals located 
in four Italian 
regions, Italy 


19 


429 


47,7 


51,2 


81,7 


79,7 


Gender, age, severity 
at admission, 
co-morbidities 


In-hospital mortality, length of stay, 
appropriateness of stay, unscheduled 
readmission rate 


IIJIIJV 


Philbin 

2000 


CRCT 
(multicentered) 


Prospective 


10 Hospitals in 
Newyork, the USA 


9 


1504 


49 


48 


77 


74 


Gender, age, race, 
insurance, medication 
use at admission 


In-hospital mortality, length of stay, 
readmission rate, hospitalizations cost 




Azad 
2008 


RCT 
(monocentric) 


Prospective 


Ottova Hospital, 
Canada 


6 


91 


0 


0 


75,8 


74,2 


Gender, age, 
satisfaction scores 


Mean hospitalizationjn-hospital 
mortality 


Hill 


Panella 
2003 


Interrupted 
time series 
(monocentric) 


Prospective 


Italian hospital, Italy 


12 


246 


43,62 




78,9 




Gender, age 


In-patient mortality, length of stay, 
readmission rate within 31 days 


IIJIIJV 


Discher 
2003 


Controlled trial 
(monocentric) 


Historical 


General hospital, the 
USA 


12 


593 












Length of stay,hospitalization cost, 
Nursing satisfaction 




Lanzieri 
1999 


Controlled trial 
(monocentric) 


Historical 


Central Maine 
Medical Central, 
Lewiston, the USA 


18 


73 


53,8 


55,9 


68 


65,7 


Gender, age 


In-hospital mortality, length of stay, 
readmission rate 




Rauh 
1999 


Controlled trial 
(monocentric) 


Historical 


Elmhurst memorial 
hospital, lllnois the 
USA 


12 


754 


42 


50 


75,8 


74,39 


Gender, age, 
co-morbidities 


Length of stay, admission/ 
readmission rate,hospitalizations cost 


IIIJV 
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Clinical Pathway 


Standard Care 




Risk Ratio 


Study or Subgroup 


Events 


Total 


H vents 


Total 


Weight 


M-H. Random, 95% CI 


1.1.1 RCT 














Azad 2008 


0 


45 


2 


46 


5.2% 


0.20 [0.01. 4.14] 


Panella 2009 


12 


214 


33 


215 


26.9% 


0.37 [0.19, 0.69] 


Philbin 2000 


105 


B40 


34 


664 


32.1% 


0.99 [0.76. 1 .29] 


Subtotal (95% CI) 




1099 




925 


64.2% 


0.58 [0.23, 1.43] 


Total events 


117 




119 








Heterogeneity: Tau 2 = 


0.41; Chi 3 = 


8.97, df= 


2 (P= 0.01); I 2 =78% 




Test for overall effect: Z = 1 .1 9 (P = 


0.23) 










1.1.2 CCT 














Panella 2003 


3 


68 


31 


173 


18.6% 


0.25(0.08, 0.80] 


Lanzeri 1999 


3 


39 


8 


34 


17.3% 


0.33 [0.09. 1.13] 


Subtotal (95% CI) 




107 




2VA 


35.8% 


0.28 [0.12, 0.66] 


Total events 


6 




39 








Heterogeneity: Tau 2 = 


0.00; Chi 2 = 


0.09, df = 


1 (P= 0.76); l'= 0% 




Test for overall effect: Z = 2.91 (P = 


0.004) 










Total (95% CI) 




1206 




1137 


100.0% 


0.45 [0.21,0.94] 


Total events 


123 




158 








Heterogeneity: Tau 2 = 


0.43; Chi 2 = 


15.07, df 


= 4(P = 


0.005); I 2 


= 73% 




Test for overall effect: Z = 2.1 2 (P = 


0.03) 










Test for subqroup differences: Ch 


2 =1.23.df=1 (P 


= 0.27). I 2 


= 18.9% 





Risk Ratio 
M-H, Random, 95% CI 



0.01 0.1 



10 100 



Favours treatment Favours control 



Figure 2 Forest plot of comparison for rate of hospital mortality. 



Effect of CPs: readmission rate 

We included in the systematic review 5 studies reporting 
risk estimates for readmission rate [5,10,22,29,30]. A 
total of 3,006 patients were analysed, including 1508 
patients in the care pathway and 1498 patients in the 
standard care groups. Figure 3 displays the result of the 
primary meta-analysis. One of the studies found that the 
risk of readmission significantly decreased in the care 
pathway group [10]. The overall RR for RCTs was 0.79, 
95% CI = 0.49-1.27, P = 0.33. The overall result of meta- 
analysis was significant (RR = 0.81, 95%CI = 0.66-0.99, 
P = 0.04). 

Effect of CPs: LOS 

Five studies were included in the systematic review (one 
randomised controlled, four controlled studies) repre- 
senting a study population of 2,095 patients. Examining 
the effect of CPs on the length of stay, out of five studies 



[5,10,28-30] three studies showed a significantly shorter 
LOS in the care pathway group [5,28,30]. The overall 
results of the random-effects model showed that care 
pathway provided a positive reduction in LOS when 
compared with the standard care (WMD = -1.89, 95% 
CI = (-2.44-H1.33 days, P< 0.001) (Figure 4). 

Effect of CPs: hospitalisation costs 

Three of the included studies (one randomised con- 
trolled, two controlled), representing a study population 
of 1776 patients, reported costs during hospitalisation 
[10,28,30]. Two of the CCTs [28-30] found significantly 
high hospitalisation costs for the care pathway groups. 
Also, the combined result of the controlled studies was 
significant (WMD = (-)2.35, 95%CI = (-)4.11-(-)0.58, 
P< 0.009) but the RCT was not (WMD = (-)O.ll, 95% 
CI = (-)0.25-0.03, P = 0.11). Overall, the meta analysis 
results of the random effects model did not show any 



Clinical Pathway Standard Care 



Study or Subgroup 




Events 


Total 


Events 


Total 


Weight 


M-H, Random, 95% CI 


1.2.1 RCT 
















Panella 2009 




17 


214 


30 


2 1 5 


11.5% 


0.57 (0.32,1.00] 


Philbin 2000 




169 


840 


141 


664 


53.0% 


0.95 [0.78,1.16] 


Subtotal (95% CI) 






1054 




879 


64.5% 


0.79 [0.49, 1.27] 


Total events 




186 




171 








Heterogeneity: Tau 2 = 


0.08; Chi 2 = 


2.79, df= 


1 (P= 0.09); I 2 =64% 




Test for overall effect: Z 


= 0.97(P = 


0.33) 










1.2.2 CCT 
















Panella 2003 




2 


68 


12 


17:3 


1.9% 


0.44 [0.10,1.90] 


Rauh 1999 




45 


347 


7 3 


407 


26.4% 


0.72 [0.51,1.02] 


Lanzeri 1 999 




10 


39 


1 1 


34 


7.3% 


0.79 [0.38,1.63] 


Subtotal (95% CI) 






454 




619 


35.5% 


0.72 [0.53, 0.97] 


Total events 




57 




96 








Heterogeneity: Tau 2 = 


0.00; Chi 2 = 


0.52, df = 


2(P=0.77);I 2 =0% 




Test for overall effect: Z 


= 2.13(P = 


0.03) 










Total (95% CI) 






1508 




1498 


100.0% 


0.81 [0.66, 0.99] 


Total events 




24 3 




267 








Heterogeneity: Tau 2 = 


0.01; Chi 2 = 


4.78, df= 


4(P=0.31);I 2 =16% 




Test for overall effect: Z 


= 2.05(P = 


0.04) 










Test for subqroup differences: Ch 


= = 0.10. df= 1 (P = 


0.75). I 2 


= 0% 





Risk Ratio 
M-H. Random, 95% CI 



Favours treatment Favours control 



Figure 3 Forest plot of comparison for rate of readmission. 
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Clinical Pathway Standard Care 



Mean Difference 



Study or Subgroup Mean SD Total Mean SD Total Weight IV. Random. 95% CI 



1.3.1 RCT 

Panella 2009 10.4 4. 

Subtotal (95% CI) 
Heterogeneity: Not applicable 
Test for overall effect: Z = 1 .81 (P = 



214 
214 



0.07) 



1.3.2 CCT 

Panella 2003 7.96 4 

Discher2003 3.9 

Lanzeri1999 5.61 4 

Rauh 1999 5.7 
Subtotal (95% CI) 
Heterogeneity: Tau 2 = 0.02; Chi 2 : 

Test for overall effect: Z = 9.67 (P 



10.89 
6.1 
7.24 
7 3 



D6 68 
:.2 396 
45 39 
■ 8 347 
850 

3.32, df= 3 (P= 0.34); l : 
0.00001) 



7 15 

2 B 
5 59 
5 8 



215 
?1f» 



17x 
197 
34 
407 
816 
1 0% 



17.6% 
17.6% 



11.8% 
39.0% 
5.1% 
26.5% 
82.4% 



-1 .00 [-2.08. 0.08] 
-1.00 [-2.08. 0.08] 



-2.93 [-4.36, -1.50] 
-2.201-2.65,-1.75] 
-1.63 [-3.97, 0.71] 
-1.60 [-2.36, -0.84] 
-2.08 [-2.50,-1.66] 



Total (95% CI) 1064 1031 100.0% 

Heterogeneity: Tau 2 = 0.1 6; Chi 2 = 6.84, df = 4 (P = 0.1 4); I 2 = 42% 

Test for overall effect: Z = 6.64 (P < 0.00001 ) 

Test for subqroup differences: Chi 2 = 3.33. df = 1 (P = 0.07). I 2 = 70.0% 

Figure 4 Forest plot of comparison for length of hospital stay. 



-1.89 [-2.44, -1.33] 



Mean Difference 
IV, Random. 95% CI 



-4 -2 0 2 4 
Favours treatment Favours control 



significant differences in hospitalisation costs when the 
CPs were compared with the non-pathway based care, as 
shown in Figure 5 (WMD = (-)L57, 95%CI = (-)3.66- 
0.52, P = 0.14). 

Discussion 

In this systematic review, the results of 7 publications 
which met the study inclusion criteria were combined to 
determine the effect of CPs on the outcomes of in- 
hospital treatment for heart failure: in-hospital mortality, 
rate of readmission, LOS and hospitalisation costs. 

This study is the first systematic review to show an 
impact of CPs on the treatment of heart failure. 

The primary finding of this systematic review was that 
the implementation of CPs for heart failure reduced hos- 
pital mortality and length of stay without increasing hos- 
pitalisation costs. Also readmission rate decreased in the 
care pathway groups (Figure 3). By looking at this data, 
it is evident that CPs can effectively improve the quality 
of care provided to patients suffering from heart failure. 
Lower mortality rates and shorter hospital stays among 
CP patients are associated with standardisation of the care 



process. However, we must be careful with the overall 
conclusions: pathways are not just documents recorded 
in the patient charts but a way to organize and standard- 
ise a multi-disciplinary care for patient groups using 
well-known quality improvement methodologies [31]. 

In the included studies, all patients were admitted to 
hospital with a primary diagnosis of chronic heart fail- 
ure. The definition of readmission rate was different in 
the included studies. In two studies, readmission was 
recorded within 31 days after discharge [5,10]; in one 
study it was recorded within 90 days of discharge [30] 
and in two studies 6 months after hospital discharge 
[27,29]. For all included studies cost was calculated for 
hospital stay per-patient but no additional information 
was given about the cost calculation. 

There are two previous generic meta-analysis reports 
suggesting that implementation of CPs can achieve a re- 
duction in some of the patient outcomes [18,19]. Al- 
though some of the findings were confirmed by our 
study, there are also several reasons that preclude com- 
parison of our findings with generic meta-analyses. 
Firstly, pathways are a learning tool both at professional 
(individual) and organizational (team) level [32], and 



Clinical Pathway 



Standard Care 



Mean Difference 



StudyorSijbgroup Mean SD Total Mean SD Total Weight IV, Random. 95 CI 



Mean Difference 
[V. Random, 95% CI 



1.4.1 RCT 

Panella 2009 2.72 0.6 

Subtotal (95% CI) 
Heterogeneity: Not applicable 
Test for overall effect: Z = 1 .59 (P = 



214 
214 



215 
?15 



0.11) 



1.4.2 CCT 

Discher2003 5.459 2.466 396 

Rauh 1999 7.12 5.095 347 

Subtotal (95% CI) 743 
Heterogeneity: Tau a = 1 .47; Chi 2 = 1 0.75, df = 1 (P = 0.001 ); I 2 
Test for overall effect: Z = 2.61 (P = 0.009) 



8.68 
8.541 



4.255 
6.97 



197 

4 07 
G04 

= 91% 



34.3% -0.11 [-0.25,0.03] 
34.3% -0.11[-0.25,0.03] 



33.3% -3.22 [-3.86, -2.58] 
32.4% -1.42 [-2.28, -0.56] 
65.7% -2.35[-4.11,-0.58] 



Total (95% CI) 957 
Heterogeneity: Tau 2 =3.32; Chi 2 = 93.35, df = 2 (P 
Test for overall effect: Z= 1 .47 (P = 0.1 4) 

Test for subqroup differences: Chi 2 = 6.14. df= 1 (P = 0.01). I 2 = 83.7% 
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Figure 5 Forest plot of comparison for hospitalisation cost. 
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pathways for different patient groups define different 
tasks to be learned, which affects performance of path- 
ways and also patient outcomes. Also most of the out- 
comes such as mortality rate, readmission rate, LOS and 
costs of hospitalisation are related to types of treatments 
given to patients and show differences among specific 
patient groups. Different interventions are sometimes 
classified under the same term. When different clinical 
topics are included in the meta-analysis, the effect size 
of the intervention mostly shows huge variations be- 
tween pathways for different patient groups. Exploring 
the reasons behind the heterogeneity rather than deriv- 
ation of a single summary estimate of the effect size has 
emerged as the main goal of the meta-analysis [33]. 
Some statistics which were estimated for general popula- 
tions from the generic meta-analysis such as weighted 
mean difference, OR or RR cannot be extrapolated to 
any patient group. 

This systematic review has some limitations. We ini- 
tially identified 46 relevant studies among 7981 total 
search results. However, only 7 studies could be consid- 
ered as CPs and met our inclusion criteria. The scarcity 
of publications on CP probably results from the fact that 
CPs have only recently become a popular tool and the 
associated benefits for heart failure interventions are still 
not clear. Therefore, not many studies could be included 
to evaluate the effect of CPs on in-hospital treatment of 
heart failure. 

In this systematic review, we observed that the find- 
ings of controlled trials were always more positive than 
the RCTs. In the included papers all of the study groups 
were experimental and the data was collected prospect- 
ively. Among included studies, three were randomized 
controlled clinical trials and one of them was an inter- 
rupted time series. In this study, measurements were 
performed on the same patients before and after the ex- 
periment, so patient characteristics are unlikely to have 
affected the outcomes. But 3 of the included studies 
were non-randomised; and historical controls were used. 
In the non-randomised studies, differences in patient 
characteristics may have affected the outcomes. Al- 
though patient characteristics were similar in the study 
and control groups (Table 1), differences in patient char- 
acteristics may explain more positive results in CCTs. 
Moreover, none of the studies mentioned in-hospital 
complications; thus, the association between hospital 
complications, costs and LOS could not be addressed. In 
addition, we assume that combining clinical indicators 
with a satisfaction survey could have given a more ac- 
curate measure of the true level of quality achieved 
through CPs [34]. Concerning included studies, only two 
studies measured patient satisfaction score [10,23] and 
reported no significant effect. As studies used different 
quality assessment tools, combining of results was not 



possible; so, patient satisfaction scores were not included 
in the systematic review as an outcome. 

Since heart failure is defined in different ways and in- 
clusion criteria can vary from study to study, individual 
patient data meta-analysis would have been a good op- 
tion to overcome some of the shortcomings of our ana- 
lysis. The New York Heart Association classification 
would have been used to perform subgroup analysis. Un- 
fortunately only four of the seven studies reported 
NHYA classification and they did not provide separate 
results for each classification. Another limitation of our 
study was that despite performing a search from 1985 to 
2011, we could not identify any eligible study until 1999. 
Thus, we cannot generalise our results for the last 
26 years but our study results are valid for the last 
13 years. 

In 6 studies [5,10,23,28-30], pathway and control 
groups were well-balanced with regard to the number of 
the patients, and in 5 studies [5,10,22,29,30] pathway 
and control groups were age- and sex-matched. More- 
over, these five studies were similar with respect to the 
age and sex ratio (female/male) of the patients. One 
study did not provide patient characteristics [28] and 
one study enrolled only female patients [23]. The title of 
this study suggests that the study sample consists of 
older women, but the mean age of the patients was simi- 
lar to the other studies included. 

Although the above mentioned patient characteristics 
of the studies were similar, we observed a high hetero- 
geneity in the statistical analysis by use of the I 2 statistic, 
which was introduced by Higgins et al. [27] . Although I 2 
values of 75% were described as high [27], no desired 
threshold for I 2 was determined. Recently it was men- 
tioned that heterogeneity is to be expected in a meta- 
analysis because studies are performed by different 
teams in different settings [34]. Using a random-effects 
model to reduce the effect of heterogeneity on a statis- 
tical analysis is a widely used approach [27]. In addition, 
it is known that sensitivity analysis should be accompan- 
ied by an analysis to show the effect of heterogeneity on 
statistical analysis [35]. A risk of bias check list has been 
developed according to pre-defined inclusion criteria 
and papers were ranged according to the risk of bias for 
each outcome. Results of the sensitivity analysis were 
given in the Additional file 1. In sensitivity analysis, rela- 
tive risks were similar for in-hospital mortality, re- 
admission rate and length of stay. A significantly greater 
mean difference was observed for hospitalization cost 
which is probably a consequence of the small number of 
studies included for this outcome. 

There is an international controversy on the definition 
of pathways [36-38]. Vanhaecht et al. defined 17 criteria 
[39] and the paper by De Bleser et al. gave a detailed 
overview on how a definition of pathways could be built 
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[36]. Recently Kinsman et al introduced a definition in 
their paper, consisting of five criteria for care pathways 
based on the aforementioned papers previously pub- 
lished [37]. Both criteria are valid and usable. In this 
study only studies meeting the CPs definition of EPA, 
which covers Kinsman et al. criteria's, were included in 
this systematic review [6]. 

According to the definition, pathways describe patient 
processes and in the planning of a pathway, identifica- 
tion, and resolution of process 'bottlenecks' frequently 
occur. However, what works for one organization may 
not work for another, because of subtle differences in 
these processes and bottlenecks. Organizations are also 
different in their readiness for and capacity to change. 
These are often referred to as context issues, which in- 
fluence implementation and effectiveness [40]. Hawe, 
Shiell, and Riley (2004) suggested as a possible solution 
to standardize complex interventions, the function and 
process of the intervention and not only the components 
[41]. This information on the context and the change 
process is critical to the ability of others to adapt the 
findings of a study to their own setting [40,42]. A path- 
way which works in one place may be ineffective in an- 
other without this key knowledge. In our opinion, this 
important issue did not affect the validity of our find- 
ings. In fact, all the papers that have been selected in 
our review included process and outcome indicators that 
provided data to understand if pathways worked (Add- 
itional file 1: Annex 2). Therefore we think that our 
paper addresses the research question adequately and we 
also think that our findings are based on consistent data. 

A final remark is that the literature suggests that when 
researchers implement a pathway in a team that is 
already performing well, one may not identify significant 
improvements. A poorly performing team may, on the 
other hand, be greatly improved by the implementation 
of a new pathway, but these teams may not always be 
interested in improving the organization of their care 
process [31]. Pathways are one of the tools interdiscip- 
linary teams can use to audit, standardise and improve 
the organisation of care. 

Conclusion 

Our goal was to demonstrate the impact of care path- 
ways on patient outcomes. By combining all possible 
results of care pathways, it can be concluded that care 
pathway for heart failure treatment showed a decreased 
mortality rate and length of hospital stay, but no statisti- 
cally significant difference was observed in the readmis- 
sion rates and hospitalisation costs. Although some 
findings of this systematic review showed that care path- 
ways have a positive effect on some outcomes, one 
should consider the limitations of this study while inter- 
preting the results. In the future, a meta-analysis should 



be performed with an increased number of included 
studies to decrease heterogeneity of study designs. We 
suggest that the findings and possible limitations of this 
study be considered in the planning of future meta- 
analyses to shed light on the effect of pathways in spe- 
cific patient groups. 
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